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A unified approach to local limit theorems in Gaussian 
spaces and the law of small numbers 


Alberto Lanconell]0 


Abstract 

Through a reformulation of the local limit theorem and law of small numbers, 
which is obtained by working in the spaces naturally associated to the limiting 
distributions, we discover a general and abstract framework for the investigation 
of that type of limit theorems. From this new perspective, the convolution and 
scaling operators utilized in the classical results mentioned before will be identified 
with the Wick product and second quantization operators, respectively. And here 
is the advantage of our approach: definitions and most of the properties of Wick 
products and second quantization operators do not depend {mutatis mutandis) on 
the underlying probability measure. Then, with the help of Holder-Young-type 
inequalities for Gaussian and Poisson Wick products proved in previous papers, 
we show the convergence of the densities towards the desired limit. We remark 
that our approach extends without additional assumptions to infinite dimensional 
Gaussian spaces. 
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1 Introduction 

The aim of the present paper is to propose a unified framework for proving the two 
following well known limit theorems: 

Theorem 1.1 (Local Limit Theorem) Let {Xn}n>i be a sequence of independent 
and identically distributed real valued random variables. Assume that the common law of 
the Xn’s is absolutely continuous with respect to the one dimensional Lebesgue measure 
and that E[X^ = 0 and VarfXn) = 1 for all n > 1. 

Then the density of converges in >C^(M), as n goes to infinity, to the one di¬ 

mensional standard Gaussian density. 

Theorem 1.2 (Law of Small Numbers) Let {Xn}n>i be a sequence of independent 
and identically distributed random variables taking values on Nq. Assume that E[Xn] = a 
for some a > 0 and all n > 1. 

Then the law of TiXi TiXn converges, as n goes to infinity, to the Poisson 

n n 

distribution with intensity a > 0. (Here, Mq := N U {0} and for a G [0,1], TaX denotes 
the a-thinning of the law of the random variable X. See Definition 1,9. 1\ below.) 
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Theorem 11.11 was obtained by Prokhorov in [13]; Ranga Rao and Varadarajan [T3| proved 
point-wise convergence of the densities while Gnedenko [5] studied uniform convergence. 
We also mention the work of Barron [2] where the relative entropy (or Kullback-Leibler 
divergence) of with respect to the standard Gaussian measure is shown to 

converge to zero (monotonically along a certain subsequence). 

Theorem 11.21 is a generalization of the famous Binomial-to-Poisson convergence. See for 
instance Barbour et al. [T] for a systematic treatment of Poisson approximation. In 
Harremoes et al. [6] the authors proved an information theoretic version of Theorem 11.21 
in the spirit of the result of Barron [2|. 

The main novelty of our approach consists in utilizing a common framework for the 
representation of the density of the random variable in Theorem 11.11 and the 

distribution of TiXi TiXn in Theorem 11.21 This common framework is based 

n n 

on the one dimensional version of two basic tools from the analysis on Wiener spaces: 
the Wick product, which will play the role of the convolution product, and the second 
quantization operator (also known as Ornstein-Uhlenbeck semigroup), which will play 
the role of the scaling operator (we refer the reader to Janson [7| for all the details on 
these tools). The crucial ingredient in our construction is to reformulate the problems 
in their natural frameworks: in the case of the Local Limit Theorem, we work with 
densities with respect to the standard Gaussian measure while, in the case of the Law 
of Small Numbers, we investigate the behavior of the Radon-Nikodym derivatives with 
respect to the Poisson distribution with intensity a > 0. This idea is similar to the one 
proposed in Barron [2] for the Gaussian measure and in Harremoes et al. |6] for the 
Poisson distribution. 

Once the densities are taken with respect to the right reference measures, then the 
convergence theorems can be formulated in the same manner (see Theorem 12.31 and 
Theorem 13.41 below) and proved with the help of general inequalities for Wick products 
and second quantization operators (see Theorem l2.2l and Theorem [XSl below). We obtain 
convergence of the densities towards the constant function one, that corresponds to 
the Radon-Nikodym derivative (with respect to the reference measure) of the desired 
limit. Morever, the moment conditions {E[Xn] = 0 and Var{Xn) = 1 for the local limit 
theorem and = a for the law of small Numbers) take a very natural form: they 

are equivalent to the orthogonality between the Radon-Nikodym density of the X^ and 
the first and second orthogonal polynomials associated to the reference measure (see 
the proofs of Theorem 12.31 and Theorem 13.41 below). The idea of the proofs of the main 
theorems is taken from [T2] . 

However, we need to pay a price for the generality of our approach. We are in fact 
able to prove the convergence for a smoothed version of the quantity investigated in the 
classical version of the theorems. Nevertheless, our technique is, at least in the Gaussian 
case, dimension independent (see the Remark 12.41 and Remark 12.51 belowL 
The paper is organized as follows: Section 2 deals with the local limit theorem while 
Section 3 is devoted to the law of small numbers. The two sections are structured in 
exactly the same manner with the aim of underlying the unified nature of the approach. 
For more information on orthogonal polynomials we refer the reader to Ghihara [3] and 
to SzegofTB]. 
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2 Gaussian local limit theorem 

Let IX denote the standard one dimensional Gaussian measure, i.e. 


2 

and consider the real Hilbert space £^(R, i3(R),/i) together with the family of monic 
Hermite polynomials {hn}n>o- These polynomials constitute an orthogonal basis for the 
space £^(R, i3(R), p) and therefore any element f of that space can be represented as 


jdx, He H(R) 



Note that 


/(^) = 

j>o 




since the polynomials are not normalized. We now introduce a scaling operator and 
an unbounded bilinear multiplication on £^(R,H(R),/i); they will be our fundamental 
tools in proving the limit theorems under consideration. For A e [—1,1], the second 
quantization operator is the bounded linear operator 


T{X) : C\R,B(R),fx) C\R,B(R),fx) 

J2xjhj{x) ^ 

j>0 j>0 


This map can be extended to a bounded linear operator from £p(R, H(R), /i) to £^(R, H(R), /i) 
for any p E [1, +oo] with norm equal to one. Moreover for f,gE £^(R, H(R), p) with 


fi^) = ^Xjhj{x) and 


j>o 


j>o 


we define the Wick product of / and g to be the function 


{fog){x) := 

j>0 i=0 

The Wick product, combined with second quantization operators, possesses the following 
clear probabilistic interpretation. (This fact is implicitly contained in |1] and further 
analyzed in [9], where a similar statement for the chi-square distribution is obtained). 


Theorem 2.1 Let Xi,...,Xn be independent real valued random variables and denote 
by fxxi, ■■■, gx„ the corresponding laws on R, respectively. Assume that the measures 
pxii ■■■iLXn absolutely continuous with respect to fx. Then, for any ai, ...a„ G [—1,1] 
such that 


+ • • • + — 1 , 


3 



we have 


dfiaiXi-l - \-anXn 

dfl 


( 2 . 1 ) 


r(cti) j o***or (ttyi) 

a/j, dfi 


where ^ denotes the Radon-Nikodym derivative of the measure Q with respect to the 
reference measure jj, and paiXi+-+a^Xn denotes the law of the random variable aiXi + 

* * * “ 1 “ OLjiXrfr^ . 


With this probabilistic interpretation in mind, the next theorem can be considered as a 
Gaussian Young inequality (see [1] for the proof). Here and for the rest of the present 
section, the symbol || ■ ||p will denote the usual norm in p). 

Theorem 2.2 Let Oi,G [—1,1] be such that af-l - \-a^ = 1 and let pi, ...,pn,r & 

[1, +oo] satisfy the following condition 

al. 1 

- - - ^ - ^ - — = -. 

Pl-1 Pn-1 r - I 

If fi G £^“(R, i3(R), /i) for each i = I, ■■■, n, then r{ai) fio■ ■ ■ or{an)fn £ 13'’(R, H(R), p). 
More precisely, 


\\T{ai)f o ■ ■ ■ oT{ar,)fn\\r < II/i llpi • • • II/n ||p„ • (2.2) 

We are now ready for the main result of the present section. The theorem is stated 
and proved in the one dimensional Gaussian framework introduced above; however, its 
validity can be extended without additional assumptions to inhnite dimensional abstract 
Wiener spaces (see Ha). 

Theorem 2.3 Let {Xn}n>i be a sequence of real valued, independent and identically 
distributed random variables with zero mean and unit variance. Suppose that the common 
law of the Xn’s is absolutely continuous with respect to the measure p with a density 
belonging to £^(R, p). Then, for any non negative sequence {bn}n>i such that 

lim — = 0 and lim = +oo, (2.3) 

n —77/ ^—^-|-cx) *^3 

the density (with respect to p) of 


n 


Xi 


+ X„ 


n 


+ 


n 


n + bj, 


■ Z 


(2.4) 


converges in £^(R, i3(R), p) to 1 as n tends to infinity. Here Z is a standard Gaussian 
random variable which is independent of the sequence {Xn}n>i- 


Remark 2.4 The classic local limit theorem is about the convergence in a specified topol¬ 
ogy of the density of towards the standard Gaussian density. We are working 

in a space with a Gaussian reference measure and hence we are interested in the conver¬ 
gence to the constant function 1. We prove the convergence of the density of the random 
variable in ( [^.^[ ) which is a smoothed version of ■ Nevertheless, the validity of 

our approach is dimension independent as mentioned above. 
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Remark 2.5 Theorem \2.3\ is a refinement of the result proved in flBj- In fo.ct, in that 
paper it is assumed that bn = an for some a > 0; with this choice (that does not satisfy 
the first condition in 112. S\) ) the extra term containing Z in ^2.4\) is not vanishing as n 


tends to infinity. Since the presence of Z in Ii2.4\ ) serves to mollify the resulting density, 
we believe that Theorem \2 . ,91 improves the result obtained in the paper IWf . 

Proof. Let / be the common density of the X^s with respect to the measure fv. 
From Theorem 12.11 we know that the density of is given by 


where g^'^ means go ■■■ o g (n-times); moreover, the density of the random variable in 
(12.4p can be written as 


r 


n 


n + br. 


/)°Tr(^ 


n + br. 


1 = r 


\/n + br, 




Here we utilized the functorial property T{X){fog) = (r(A) 5 f)o (r(A)g') and the identity 
r(A)l = 1 (note that the density of Z with respect to g is one). Observe in addition 
that we can write without ambiguity the right hand side of the previous equation as 
r(^^^7== (again as a consequence of the interplay between second quantization 
operators and Wick product). 

Observe in addition that assuming the X„’s to be with mean zero and unit variance is 
equivalent to require that / is of the form / = 1 + Ylik> 3 lkhk] in fact 

0 = E[Xn] = [ xf{x)dii{x) = f hi{x)f{x)dg{x) ='ji (2.5) 

t/ M t/ M 

1 = Var(Xn)= f x‘^f{x)dia{x) = f h 2 ix)f{x)dia{x) + 1 = 2^2 + I (2.6) 

t/ M t/ M 

(recall that hi{x) = x and /i 2 (x) = — 1). Our aim is to prove that 


lim 

n—>- + 00 


r 


=)r 


= 0 . 


Vn + b„ 

First of all, exploiting the associativity and distributivity of the Wick product we write 
1 


\/n + br, 


r 


1 = 


Er 

n 

Er 

i=i 


1 ^ joj — ^ 


\/n + b, 
1 

\/n + b, 


\/n + br. 


:)r'-'o(r( 


\/n + b, 


V-i 


Now take the £^(M, H(M),/r)-norm and use the triangle inequality: 


Vn + hr, 


jon _ 


1=1 


s 5: 111 

1=1 


( 1 

)r=u 

hi ^ 

)/-i) 


\\/n + bn 

V Vi/n + 6„ 

1 

( 1 ' 

ir'-u 

1 ' 

1—1 

1 


Wn + ^ 

^yjn + bn^ 

1 
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Now apply Theorem 12.21 (actually we need only the £^-form of the inequality which was 
proven before in the paper [10]) with 


to get 


r 


y/n+Tr^ 


(y.\ — 


jon _ 2 


n — 1 
n + bn 


and a 2 = 


+ 1 

n + bn 


< 


< 


n 

5:||r 


\/n + 6, 
1 

\/n — 1 


r"'o(r( 


Vbn + 1 


n . 

3 = 1 


y/n+Tr, 

1 

y/bn + 1 
1 


/-I 

/-I 

fOj-1 


Observe that employing once again inequality fl2.2p we can bound the last sum as 

1 


3=1 


y/n — 1 


r 


-1 


< 


EF 


n 

3=1 
= n. 


y/n - 1/ 


Here we are using the fact that / is a density function (in particular is non negative and 
with integral with respect to /i equal to one). Therefore 


T 


y/n + br. 


jon _ 


< 

d 

y/b 

< n ■ 


< n ■ 


= "(E 


/-I 


n ^ 

3=1 


V^n + 1 
1 

y/bn + 1 

1 yk 


/-I 

)/-i 


k>2, 


+ 1 


\lk 


where the q^’s are the components in the decomposition of / (recall (12.5p ). Hence, 


y/n + br, 


jon _ 


< n ■ 


1 


y/bn + 1 


/-I 




< n 


k>3 


bn + 1 


bn + ^ 

^/d|7, 


\lk 


k>3 


The last series, being equal to 


1, is convergent; we can therefore pass to the limit 


as n tends to inhnity and obtain the desired result. 
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Remark 2.6 The assumption on f to be in i3(M),/x) can be relaxed, using the 

Nelson’s hyper-contractive estimate, to f G p.) for some p > 1. 

3 Law of small numbers 

Let p denote the Poisson distribution with intensity a > 0, i.e. 

k 

^m) ■■= A: e No 

and consider the real Hilbert space £^(No, 2^°, z/) together with the family of monic 
Charlier polynomials {c“}„>o. These polynomials constitute an orthogonal basis for the 
space £^(No, p) and therefore any element / of that space can be represented as 

/(^) = 

i>o 

Note that 


k>0 j>0 

since the polynomials are not normalized. As before, we introduce for A G [—1,1] the 
second quantization operator as 

r(A) : £2 (No,2^°,z/) ^ £2(No,2^°,z/) 

j>0 j>0 

(We use the same symbol as for its Gaussian analogue since we believe that there will 
be no danger of confusion). This operator can be extended to a bounded linear oper¬ 
ator from £^(No, 2^°, p) to £^(No, 2^°, p) for any p G [1, -|-oo] with norm equal to one. 
Moreover, for f,gE /l^(No, 2^°, p) with 

= and g{x) = ^5jc'^j{x), 

j>o j>o 

we dehne the Wick product of / and g to be 

{fog){x) = 

j>0 i=0 

The next dehnition provides to some extent a discrete analogue of the scaling operation. 
It was introduced by Renyi in [T5] . 

Definition 3.1 Let X be a random variable taking values on Nq and denote by px its 
law. For any a G [0,1] we define the a-thinning of px to be the new probability measure 
on No given by 

(T.,i^x)({k]) := ^(^)a'=(l-ar-V({n}). t e N„. 

n>k ^ ' 
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With a slight abuse of notation we will write T^X for the a-thinning of the law of X. 
Observe that the law of the random variable T^X coincides with the one ofYi + --- + Yx, 
where the Yi’s are Bernoulli random variables with probability of success a which are 
independent of each other and of X. 

The next two theorems show an interesting connection between a-thinning and stochastic 
independence on one side and Wick product and second quantization operators on the 
other. They were obtained in [n] (see also 0) where the reader is referred for their 
proofs. Theorem 13.21 and Theorem 13.31 below represent the Poissonian counterpart of 
Theorem 12.11 and Theorem 12.21 respectively. Here and in the sequel, the symbol || ■ ||p 
will denote the usual norm in £^(Mo, 2^°, u). 

Theorem 3.2 Let Xi, ...,X„ be independent random variables taking values on No and 
denote by vxi, ■■■Wx„ the corresponding laws, respectively. Then, for any ai,...,an G 
[0,1] such that 


ai • -f- a„ — 1, 


we have 


r(ai) 


di^xi 

dv 


o ■ 


o r(aji) 


d^x„ 

du 


dl^Tc^Xi+-+Tc„X„ 

du 


(3.1) 


where ^ denotes the Radon-Nikodym derivative of the measure Q with respect to the 
reference measure v and vtc Xi+-+Ta„Xn stands for the law of the random variable 

TaiXi Ta^Xn- 


Theorem 3.3 Let ai, a„ G [0,1] be such that ai -I— • a„ = 1 and let p G [1, -|-oo]. 
Iffi,---,fn e £*’(No,2^o,z/), thenT{ai)fiO---oT{an)fn e £p(No, 2^°, z/). More precisely, 

II r(ai)/i o • • • or(an)^n lip < II /i lip • • • II /n lip • (3.2) 


We are now able to state and prove the law of small numbers. As the reader will notice, 
the proof differs only for few details from the proof of Theorem 12.31 This conhrms the 
abstract nature of our approach. 


Theorem 3.4 Let {Xn}n>i be a seguence of independent and identically distributed 
random variables taking values on Nq- Suppose that the X^ ’s have mean a (the intensity 
of the Poisson distribution) and that ^ 2^°, z^). Then, for any non negative 

seguence {&n}n>i such that 


lim — = 0 

n^+oo 77, 


and 


lim 

n—^+oo 



n2 


+ 00 , 


the density (with respect to v) of 


n 


n + bj, 


(Ti W + • • • + Ti X„) -t- 


n +hr 


■ U 


(3.3) 


(3.4) 


converges in £^(No, 2^°, z^) to 1 as n tends to infinity. Here U is a Poissonian random 
variable with intensity a which is independent of the seguence {Xn}n>i. 


















Proof. Let / := be the common density of the X^s with respect to the 
measure u. From Theorem 13.21 we know that the density of TiXi + • • ■ + TiX^ is given 

n n 

by 



where means g o ■ ■ ■ o g (n-times); moreover, the density of the random variable in 
fl3.4p can be written as 



Here we utilized the functorial property T{X){fog) = (r(A)5r) o (r(A)g') and the identity 
r(A)l = 1 (note that the density of U with respect to u is one). Observe in addition 
that we can write without ambiguity the right hand side of the previous equation as 
(again as a consequence of the interplay between second quantization op¬ 
erators and Wick product). 

As in the Gaussian case, the assumption E[Xn] = a is reflected on / to be of the form 
f{x) = 1 -|- 7 iC“(x); in fact, since c“(a:) = x — a we have 

a = E[Xn] = '^kux„{{k}) = '^kf{k)u{{k}) 

k>0 k>0 

= '^^c1{k)f{k)u({k}) + a = aji + a. (3.5) 

k>0 


Our aim is to prove that 


lim 

n^+oo 


r 



0 . 


First of all, exploiting the associativity and distributivity of the Wick product we write 



Now take the £^(Mo, 2^°, z/)-norm and use the triangle inequality: 



< 




1 


An application of Theorem 13.31 with 




n — 1 
n + bn 


and 0:2 


bn + ^ 
n + bn 
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gives 


r 


n + br, 


jon _ 


< 


)/-i 

J=1 

1 


S E||r(^)r-1L'||r(i;;;^)/-i 

i=i 


r 


+ 1 


/-I 


/Ellr 


i=i 


n — 1 


/ 


■«j-i 


Observe that employing once again inequality fl3.2p we can bound the last sum as 


E|K^)r-‘ 

j=i 


< 


Eiid^)/ 


n — 1 


i=i 

n 

< Eii/iii"' 

i=i 
= n. 




Here we are using the fact that / is a density function (in particular is non negative and 
with integral with respect to v equal to one). Therefore (recall fl3.5p ). 


r 


n + hr, 


j;On _ 


< 

< n 

< n 

= n 

< n 


r 


f)ri + 1 


/-I 






p 


p 





/-I 


i>2 

1 x2 


+ 1 


+ 1 


\l] 


i>2 


The last series, being equal to II/II 2 ~ is convergent; we can therefore pass to the limit 
as n tends to inhnity and obtain the desired result. I 
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